An agent is said to be in a collaborative environment when multiple
agents cooperate to produce the desired output.
When multiple self-driving cars are found on the roads, they
cooperate with each other to avoid collisions and reach their
destination which is the output desired.
4. Single-agent vs Multi-agent
An environment consisting of only one agent is said to be a single-
agent environment.
A person left alone in a maze is an example of the single-agent
system.
An environment involving more than one agent is a multi-agent
environment.
The game of football is multi-agent as it involves 11 players in each
team.
5. Dynamic vs Static
An environment that keeps constantly changing itself when the agent
is up with some action is said to be dynamic.
A roller coaster ride is dynamic as it is set in motion and the
environment keeps changing every instant.
An idle environment with no change in its state is called a static
environment.
An empty house is static as there’s no change in the surroundings
when an agent enters.
6. Discrete vs Continuous
If an environment consists of a finite number of actions that can be
deliberated in the environment to obtain the output, it is said to be a
discrete environment.
The game of chess is discrete as it has only a finite number of
moves. The number of moves might vary with every game, but still,
it’s finite.
The environment in which the actions are performed cannot be
numbered i.e. is not discrete, is said to be continuous.
Self-driving cars are an example of continuous environments as
their actions are driving, parking, etc. which cannot be numbered.
4.Episodic vs Sequential
In an Episodic task environment, each of the agent’s actions is
divided into atomic incidents or episodes. There is no dependency
between current and previous incidents. In each incident, an agent
receives input from the environment and then performs the
corresponding action.
Example: Consider an example of Pick and Place robot, which is
used to detect defective parts from the conveyor belts. Here, every